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Abstract of JP2002074325 

PROBLEM TO BE SOLVED: To improve 
detection precision much more and to 
precisely detect a desired abnormal shadow 
as an abnormal shadow candidate with regard 
to a method for detecting the desired abnormal 
shadow in the candidate area of the abnormal 
shadow detected by an iris filter processing 
and the like. 

SOLUTION: A candidate area detecting 
means 1 1 inputs picture data P of an object 
and detects the candidate area included in 
picture data P. A feature quantity calculation 
means 12 calculates the feature quantity of the 
candidate area. An evaluation value 
calculating means 13a using a Mahalanobis 
distance and an evaluation value calculation 
means 13b using a neural network each 
calculate evaluation values from the feature 
quantity. A judgment means 13c complexly 
judges whether the candidate area is 
malignant or not based on the reliability of the 
two evaluation values. An abnormal shadow 
detection means 14 detects only the candidate 
area judged to be malignant as the final 
abnormal shadow candidate. 




Data supplied from the esp@cenet database - Patent Abstracts of Japan 



http://v3.espacenet.com/textdoc?DB=PAJ&IDX=JP2002074325 



2004/03/03 



d9) n*mmffT (jp> 



(12) t& 



(a) (io^ms^ns# 
#^2002-74325 
(P2002-74325A) 
(43)&BB B ¥<£14¥ 3 n 15 B (2002. 3. 15) 



(5 Dint CI. 7 




F I 




G 0 6 T 1/00 


2 9 0 


G 0 6 T 


1/00 290A 4C093 


A 6 1 B 6/00 






7/00 350A 5B057 


G 0 6 T 7/00 


3 5 0 




350C 5C054 






HO 4N 


7/18 K 5 L 0 9 6 


H 0 4 N 7/18 




A6 IB 


6/00 3 5 0 D 








*BI* mJm<D&7 OL <£14H) 


<21)ffl«#^ 


&H2000 - 263641 ( P2000-263641) 


(71)fflRA 


000005201 












5JZfifci2£E8 MSI R (2000 8 31) 










(72)$89J# 
























(74)WSA 


100073184 


















(54) B8«0*»] 









(57) [gift] 

U n\z>J fcfXffiRt£ffll*SiWIfiIS:aJ3Mfti3a*}<j: 



i£3 

33 



s 



\9i 



2 

«M8f 



(2) 



*#Bfl2 002-74325 



©B«a«$aaiu 

<*£ft?it&&«*it LTfctti-f -set -sit® 
BBBBBtB^au 
[B*B2] tt^1«:a>tt»«B«$SriBiftfi#l=S 
r5l*TKE«+«>S«BB««*Btii-r-5R#»BB« 

BEBBB*l::»-3l»T. fIE«lf$Sli«!*<DSSIS^ 

nth u 

Bwa»i=»-3ivc. is»©«s#ai=j:y«rEis«« 
Ba>flrfiBe«-¥&fti=*tt u 

fljEfiif itDitgg? fc -s t aa ttitzmsimm^o 

BBBBttHi**. 

^i*TKB«*<Ds«BB««*«ai-*-*a««B«a 
bubbkbivc. 

aEBaa*i=»-*t»-c» a£ftaaiia*a>Ba£& 
¥»£ai*Ta^a£-r-&a£«£#jai:. 

BaBBBmaB. 

BBaaaa^Bftt. BEaBfiKB^-caEBBB 

r3t^r«rE«l«ffi«A<0fa(DS#»»-C**^5A^ia 

ana*-* - * saat-r *b*b 3 eaaattiiiMft 
bbuibb. 

tfXEBlcB-^BS^a-CBSCitaafc"*- 

at -r-sa*^ 3 *f=i* 4 Ee<os»i8SB(s*i«ttis 

So 



fci* 4 Etta>aa»aiaaatiiaB. 

[0001] 

[»M©Bf *aHI*. ttBttH*l=£lt 

-5H*BB-¥»«^5R<bBB«lf=«a*n*. H#&a 

BB©«ai*aj3«»:i;afii=Bu a«i=i*. Jt^pais 
[0002] 

[«E3tE<D«tff] «*J:U, ■*&Bfc:Bl*Tt*. tt^f* 
<©»B«S«£ffll*TBB»£aSiU £fc*0>J?i£a 

cttf-attl^frfc^To-S. fit. ca>»l«§ili 

[0 0 0 3] BAtf, fLSOBfiSBMi: LTSS^ii 
£ Lfcf£»rffl»8«aiII«> fz*}l*TI*. ■f-OHB^&B 
.0>BBBB«aill-r«c£:]btiKB7fc«^ «B#l=«fc 

■3rii!&rLt,wBi=-€-©B#aa©»B«aa-c#* 

BBBB^fi'J*5£«bBB MB 

[0004] ^<Dsai=/Sx4t<Dt l-c, ti-aaaa 
satxrB«BB««*e»M(=Bffi-r*«fe5i=Lfc»t 

j?B3tBii!JBi£ISr (CADM; Computer Aided Diagnosis of 
Medical Images ) a>9f&A<£|j&iiAs'?l^<i>o 
[0 0 0 5] t*Jit>*>. CADMJStfJI*. H#BK<DS£tt 

a«>ffa*BBMtt*Bi::B-3it-c. bbbbbb*m- 
*aefflivcenni::ati]-r«t.a>-c&u. croise 

B«««)ttdlfflai: LTI*. ±«t LTBflBBBB«B 

'h5R<bBBB»*Bm-r*«)l=a l-fc^E? * □ 
*./U*«J3IS?A<llB**iTl*.& (/hflBB TDRSiBlcfc 
it«BBBBB CT-f 'JX7^*« J B7BBBB9 

^IfflXS D-11 Vol.J75-D-11 No. 3 P663~6701992£p3 

fl. r^BBBBBtB^fc^u^^-PSJ-^-f^^lz 
<fc-SB^5K<b«Ottffij B7BBBB¥BBXtt D-1 
1 Vol.J75-D-11 No7. P1170 ~1176 1992^7 fl s 

MEDICAL IMAGING TECHNOLOGY Vol.12 No. 1 January 1994 

[0006] T-f 'M7-f ;u*fligi*. iHB«-ft<D«fi 

43E©a*ao>s*fii*«-r7'-f yx7<rji.*iii:*iB& 
io^aniiei ro - -ov & tBaaaoBaBB z am 



(3) 



¥fffl2 O 02-74325 



[0 0 0 7] t7tni?- 7 4 )ir*W!M\*. ®& 

tz fc It -5 US <Dt#®fl<) Jfcffi a> - o & * tt'jt«K1tlMS 
[0 0 0 8] mtzs JL&LfrT-f 'JX^-fJUSfikS"*^ 

7 * p x-z> * jmmmiz * y m e>*ifcit#0Sf£<D«ffi 

^«CD5ft. XttRiK^AttMtK (KIT. ffimotziblE 
Dmi = (it- mi ) 1 S f' ( x* 



[o o o 9] eijjtis. r-f ux?^ ;u^sasi=j:or«i 

U ■1£ltl$a>**||f|t|imMt& L?ttlii-*-«£ft*t 
&S3tlTl*ft <ttMW9-1 6723801) . CCD 

> hP e-£i:£ffl^-i>C,!:;!><-C'#-5. 

[0010] zomEHKttrci*-?/^,/ exis 

(1) -CStt£4l.«Dnii«8l*U ttfll 

-So 

[0 0 1 1 ] 

[»i i 

nfi ) ( 1 ) 



Jtfc'L. Ziiirtf-y? y X ( i = I ©IE?* <h i = 2 CO 
HSRi^iro/t^- >coK'J) wiC5*»*ff 
H, r ft to ft. 
Sj= (l/Ni) £ (x'-mi) C x*- nfi ) 1 

X G vv i 

1?= ( x 1 , x 2 , x N) 

£ f 1 tot £ i offifr*] 

nfi= (l/Ni) £ 

X G w i 



3E6 (1) ictto-C. T»«MNI=»&tiri^ffBtUfe 
( i = i) tto^/^S tfxffi 

JBDmK StteK«5t-r^*^->-J' i 5^ ( i =2) £C0 
H\=7J tfXffilSIDntf^gtiJU Dm1<tDm2i:£tt;®L 

ffi&DntfJ; y iSt%«$, -Tfctoft Dtn1 < Dm2<0ffi^l** 

7M7y exffii»Dmij:y»tt(a»$*r/<*— >f 5 

Xi(D7/\7y eXffi!SDm2A<iSt^^ "TfctoftDml 
>Dm20«ftl*S1£l*fe-e&«£fl£U ®1±&§5<»:« 

[0012] £fc, «««««*iisursise»(D*s 



ttMU=£lt «tK4«SK1b^ 7^ * 0) £Jgttffi»J j Effl 
U®X^Sf36# JAM IT Frontier '99 Bt;H8!X& P. 89 
-93) . NNI1 ¥8fflf-*«AALT*iSffl\ 

$tLt. tt/J*SK1bl*l?£*t;Btt46fl cmtasfl. 
^■ttism) £tefflf-5<, NNtottiafii <o.o*&i.o 
coraronafS) ^«««iU(Dffii±s<t u 1.0 i=>fi-3< 

lii:S14SA<S<'S-5«»:5lc^S*-B-^ 0 "ffctoft. * 
BfflH«l=S*4i««tt«*am«a (5K<b«BIHa> 
Btt. 5EJi<b&g5a>®Sl<D¥*3. 5K<bP3§5coR»s£<D 



(4) 



*#g§2 O 02-74325 



MAI*. BH1S0.3 i:SSL. Ui*fii*<0.3 
0.3 *iSC0Ji#l=3fS14i:*a£-r 

•6. 
[0 0 1 3] 

IC<fc-5DmU Dm2(DfflA<. Dm1 / Dm2> 10. 0£fc 

l*Dm1/Dm2<0. 1 &&ft&£1Mtt&tt£ frfetf+S* 

ffl*<0.9 Jil±*fcl*o. 1 &T<kfc*fci:*ft®WfcliI<l:«£ 

mtmm&o&zwmwv # *R8Wfca & u -> tz 

#K N NIC £ S«5ta:l*<i*It±jW£t*C t 

[0014] <gra«ig^#to!><AyifflA/T-^.sii 
[0015] fcfc\ ±iBicfc^ri*. fttti 
[0016] **Bjii. ±&mmi~ffi*s 7^ux7< 

•r & - <!: $ § w <t -r -5 1 0> T? & s „ 

[0 0 1 7] 

[^®£fis*-r-&f=*><D#ift] Mwi^iitisi 
««ta*ai*. &ww<D&m®Mm$m-r®&mmz& 

mmommtfe&v & s t «s * titzmmi&®<D* sft$ 
[ooie] ztz. *«6B^©a«fge«*f«ai^i*. 

U afttattOftafiSfftbU tt»«l= 



[0019] *»HjiK«fcsft#iai5t£ti8ai£si*. a 
■r-5ifi^*ys#a<t. «^«s#isic«fcyflirMfl)^»^ 

T8StiS-*-aft?SBig<§S*iH*tij#K£ £ti;LfcC £ 

[oo2o] **Bj<os«isKS««iajssai*. 

[002 1] Bfaroma^tl*. Itt^lf 

[0022] *fc r«M«iJa<D^erSj mm&m 
ay, fflUfit. ^-y>K x> ha e- 
[0023] *fc r^ffiiij tit. mftfemnfemm® 

[0 0 2 4] £fc r^fiE<l(7)<i®JSj #fPffifill= 

a*LT. •^■a)HI^lfilA^&*lJSL.^#s^lJSlss (sttt-cfc 

A<10. 0£l±-C&*vl*«1±-CfcS pIt614*<I^JcS < , 0. 

*f=. paii*<i ~2Jii±<D«£i=i*si4-e&-s.pniii4 
i.A<JiiEfi®K«rta)<i®gJ:yi*e<<f*o - 
m (ta*a) *<i.o i=jatM5t*ffiis<DPitgttj!)<a<. o. 

0 l::ifilM5£#&teCDprftt±*<m*fc«>. H>1iaA<0. 9 
Jil±-C&*il*SitfCfc*Brt614A<l^l=B<. 0.1 JUT 

ii (ana*) rt<Dwaffl«>«fflfii*#«i=at^s 



(5) 



*#§fl2 002-74325 



[ o o 2 5 1 tt£t>*>. mmmo>mmmz&r3^x&. 
^wsrtaj tit, &wjz¥mz&i)m.thztitzwm®. 

[0 0 2 6] ftfc\ ±lH*9S#^l3«t-5*«S<7)^©l*. 
16. Stt*fclifi14(0S«^g. SUM*. IE«P£1*£B 
[0 0 2 7] ±IB&»(D«S3M£0>-3*.<D1 -Ot LT. 

[0 0 2 8] ±SE*g»<D*!]5£#&i: LT. 

[0 0 2 9] 

^•r-s prat's y, mmo>mi$&&$:m%:fe&i% 

[0 0 3 0] 

[003 1] Rft|&etiMiltttt]gttioi=l*. ®«g&SSg 

«t*0>msf&ero«*if«list <jbit. flMiofeJMLiclMl 
«wtt»3) *«mr*«aia*ttai^«iii. &aiL 

^fflorpffifg£gta-f aiwiiff tavern b t. # 

1TCfc«*9*€«£-*-«'M£¥ISki3c&. «tti**ifc 

*tS„ ±GfFflffi*lU9»13a. 13b ¥05£^a:i3c 
t T?ttftflC*IRi34qi|j8$*i.-Ci««. 
[0 0 3 2] U±OJ:?l::fllJftd*ifc*JIJtKtt 

[0033] HttNti»iMiltttliBBioi=i*. 0{*rr£ 



•5W0ffi*tii*fa:i3 b A< 9 oOltaa^ftft^rffPfiBiffl* 
«m\ S«KHBttm*Si4A<«»»l=Sttt*i|«* 

ftfefMMMfta>*«ji*tti$iRM£ urem-r*. kit 

[0 0 3 4] ¥LM*fflKLfc»S*«li«-Cfc*v>^y 
77<P (02 (1) #88) A<«ffi^ia«feai^Slll=A 

WBtttni-r*. 

[0 0 3 5] OTAI*. 4 )LJ*±lZtil-H>1&Mi§m 

(Bttfll^tt) J^jW=ttl*CiaWai Stir fey. Big 

1=*+*-*. 

[0 0 3 6] 7«fU^7-f;^tt. CCDiRffifilCtta* 
^SB** HU0>Jg*g£dl33-r-5*©T?&y. T-f'JX. 

[0037] JiiT. HarotlSIiLfe?^^? 

h;u*H2 (2) ic*-r*ai=iie«»Pi ©^iD^ift 

(3) l=*?-<fcdlC^E^* hVl.A<#S0>£l=&+-f & 

I*. **l*<IS©P&§JPi fl>«»«Stt£ft-5. ftfc\ 02 

(4) l=»*J:3ft9IJft«0||*lt|M$n±«<&&Lfe 

[0 0 3 8] JJtTlCT-f 'JX7<;U^ffl31©M«:MftT 

[0039] $?\ Jtatft5i®«*i8KE-r'5^T<D© 
sfticotvc. «-■« j rti=TKxt (2) ic*-r«-»ft 

•So 

[0 0 4 0] 
[»2] 



(6) 



4#gg2 002-74325 



6 = tan' > 



< f l + f2 + f »+' 16> - < f 7+f 8+ ^9+* !0 + f 1 1> 



( 2 ) 



[0 04 1] »^<t^SB#«1ifi£-r -S^TCOH 

C = (1/N) 2 cose j 
1=1 

c z v n i*a S 1131$ *«C>I=¥& R cDRrt 4® 
iltcDSu 6 j l;miigm<fc*<DRrtCD«-iIiift j 
ttttfc. -E-<Dfi-li^ j l3*Jlt4±i2SC (2) 1?^til**t 
fc^E*? h^td^-rft-efc-S (04#gg) „ LfcA< 
-sT-tlES (3) VWtZtiZSk'P &Ctf*£ti:m£U% 

[0 0 4 3] tc%t. HJlPigPi ©ift€ia>#iil^ j 
i=ffiie»-r. ns^<oHjiigE©<o*.DeiJSia]<fci«). -ties 

S|S<Di!3ii±:l^C<!:;!><-C?#.5„ -7J. Ol'gfemtiiifflm 

3 *LfcBHl T £ _t@ •& SlWf * - £ |= J: o T H 

x = k+n cos 12 k ( i - 1 ) 
y=l+n sin I 2 7t ( i - 1 ) 

fcf£U [x], [y]l*. x, y £jg;lfcl>©*a>E8t-<? 
[0 0 4 7] S&lr. *Ott#J«±<D«JiCD€-S-i:l: 
tU -t<0S*SC imax&±X<D 
C i ( n ) = 2 I (cos 9 n ) / n I 

i = l 

Tut>*>a (e) it. t&^mmmmt u *s>5£Rmi 
(n) sstu-r-atcD-efe.s, 

[0050] CC1?Rinin £ Rraax tit. ffitii l-<fc 5 <k 
C i Ba »= max C i ( n ) 

III oS nS laai 

C = ( 1 /32) I! C !„„ 
i-i 



[0 0 4 2] 
[*3] 

( 3 ) 

[0 0 4 4] *&i=5885fl>*Hii=jsix-ci*. fflHco*:# 

4IC^-rt<0<kM)Sy. iSBiS^S+/£>t LT 2 n/M 

li. 11.25 SC*tC032^|fi]*C9*) CO»8tl*(Di8±<DHJ 
5f|CD.*T?±IBm4>fi<DgWI£fT-5 tcOT?*-5o 
[0045] CwT»iil©j9±i:ft-3t, A^li 

iR^e>n#i<oiijRcoffia ([x], [ y ]> \t. mswrn 
ommz (k, i ) t-r*i\2, ties u> % (s> -c 

[0 0 4 6] 
[»4] 



/Ml 
/Ml 



( 4 ) 
( 5 > 



0 KJH*C03i4>gC<fr<5o 

[0 0 4 8] JI1tttl=l*. *r i SBCDj&INfccOISLtl:: 

C i (n) STIES (6) l=<J:y*«)*„ 
[0 0 4 9] 
[»5] 

R BinS nS R max (6) 

[0051] mz. *}m'<t M,mo>m*>&c sties 
(7) *5«fet/ (8) iz&ynn-rz. 

[0 0 5 2] 
[»6] 

( 7 ) 
( 8 ) 



CC-CxC (7) (DCinaxI*. 5C (6) -e^e,*tfc»|*« 



(7) 



&R|2 O 0 2-7 43 2 5 



[0053] LT±rco»*j«(7>»rs]«ico^r^: 
(7) a>tfS*u-c^co#®±icfcit^Hii^a)^« 

[0 0 5 4] fit, 3 (8) T*l*. CO^Ht^O)^ 
(7) -C^-^t»^m*SCDg^Cimax$JS^tta>^ 



CI (n) = 



n - R oin + 1 



cos 0 ,) 

io 



iaU§©£7?|S) (8) T?l*32^ia]<Dlg££0!l*> ICO 

*<ra*HSMMMrc*y, i <T*^i*«tf«jft-cii 

[0055] MSEOmf SC i ( n ) (Dtmi*. 

sc (6) a>tt*pyi=TiE5C (6 ') sffl^rt*tv 

[0 0 5 6] 
[»7] 

RoinSnS Rnax (6 ') 



-r a (6 -) it. «ttL«fco<t-r*Haee© 

#g<0«/MlRmin l=»!5Lfc@I^$S&^<t: U SSjS£ 
Rmin ftt&Rmax t LfcaSfflWT'^*eC i (n) 

[005 7] ft«S*(ll¥Kl2l2. 7-f 'JX7-r;U*K 
«fco-C«til*4tf=«^l||ICOLxr. *G>*M*. MSP* 

fci*ja«sa)t#sta$fftti-r-5)o 
[0058] «Ht««o>fti rosatt LT. Ifi^g 
o*siqi*<Ricifii^#-c-fc.i>cii^s,. riss p (s p 

readness) £fijffl-r£. 13 6 izmTJi 5 l=. &tb£*l7i 

S p = A ' / 7t R 2 

asm**.. «i««*a)aijsffis©t^ 

SS(ilSOSIg£P (S) iU CfflS 

fiffls*j<ti;«ap cs) i=a-3#. TE£*y. «■» 

var £&+m20>ttWim (10) . UVh^hcon 

var= II (S-S) 2 • P <S) I 
con= 2 I S 2 • P ( S ) 1 
asm= 21 P ( S ) I 2 



£1lMM-Cfc«aMI!M*Pi P3 I-OLn 

T. PSg<&ffi»AfcJ:tf*-a>fi»C>AO£#tf>. I6AO 
**Oi USSAtPIKDffiSI^^-r^^gRtDffiiSR 

*>, (Rsnt<giffi««i*<s^«aj»a)ffi»SA - t-r 

[0 0 5 9] 
[«8] 



( 9 ) 

■f&30>ftWi& (11) . ft^->>hasm $aTSS4<D 

*$sta (12) £j?aj-r-&<, 

[0 0 6 0] 
[»9] 



( 10) 
(11) 
(12) 



£fc. tiMfMUBttO**** I FED (Iris Filter 

Edge) Mtezm^TUtb-rz. UITI=. *a>A*n¥& 
■ci FEDis#$^fie-r*E5roffffl$*-r0t?fcy. m 

81*1 F EDlBfili&^-rfif^B'efc-So 
[006 1] *t\ 7-f UtttUd 

tti LfciE^fuairotxr 7-r yx7-f wmm&mm 

LtzmmL3Lvvw& (i fedis) 

[oo6 2] -tut>*>. 74 yx^-ciusjagrost 

(7) i=*ivc. %ie«^&ikM«i:»tf« i sero 



fcfius: (e) , (7) i=jst^ri*e*ffl 

-SnflXilfcRmin J£l±.Rmax UlTt fCL^^ 

[0 0 6 3] C<OJgS. aSHXtfflMfMPl ^PP3 
©rtSBlcfc4«^l=l*» E7lc^-r<fc5l^ it (7) A< 

•v>p 3 fl>ia«Btxii-r-5ii^$m^-r*. @ 

7(03gi^1 ICOC^TIJISStB 1 , B2, B3, B4 
$ft*U &BlS*2l=OlvCI*Hil§B2, B5, B 
6, B7£fI^-$-&. 

[0 0 6 4] -y,. itrnmnttHSMWAP i . P3©rt 
fiBi=fc*»di=i*. at (7) £t$-&<&i*. 
;*Silif&eA£*i*-f$££-c-feS. Tfc*>*. *»« 
«pi , p 3 «m0i=&«£SH*3i=oivctt. as 



(8) 



&BS2 002-74325 



11313 fi#£li;pt £ig£l=3S (7) <Dfilj!><£*<»:fc 
[0 0 6 5] C(0<t5l-. «ffi^«$^tiE^^Jlia) 

±mmiz-oi*xmx&Bmmt u *t (7) 

[0066] «*s$ijs£pi ronsprois 

3Hco^T©*-7>hfii*±-r rij ttty % mmf&& 
pi -v>P3 o>rtS»(DiS3ii=-5t^ra)* , 7> nai^-r^r 

roj tHk). «nt««Pi A>P3 ©inigB±<Disi3ii= 

*t4„ ^<D*>7> h<KDi®«^ I FEDSHft,»:3£8-f 

•&„ 

[0 0 6 7] JKK. CO I F ED®«IZ-Dt\rfelT<0fll 

[0 0 6 8] ?tet>*>s E9lz5t-r<fe5l-> «1«®iaP 
1 , P3 rofi'O^AO^^to, CrofifoMiAOA^J&l* 

ic^jfOfcoT i iHfrZ>2WmKtzimfflLtz>!jL& j i: 

[0 0 6 9] C©i £0> I F ED®«IZfclt**0> h 

lit j M.<r>ii^^ hfiit^iai 01=5%-*- t-u* 

XI=*-7> VT-jrf-th, JittMlcl*. 

Pi, P3 OttSPK&Sif^li. i^l FEDl«l: 

«l«Pi , P3 ©fl-Sii=fcihr* j &<r>-h^i/ r-fitt, 
is] i <o r i j <t«t^is] j <d n j ttf&m-tzffliz 

[0070]-*, i ^A<^ffitnupi , p 3 (onm- 
*y. fr-o j I!ii,mmm®p^ , P3 roweucifc-sig^ 

lis i JUL j£<fc h<BI*0-t?fe-S<7>-C-. 
is] i to ro j ifit^iai j <j> ro j iA<3t^-r-&«iir 
r i j h-r^o 

[O07 1] i j5*<«s!*t«IJaPi , P 3 0>2M8 

Bizfcy, j j&t,^tt$SJstPi , p 3 ©a«Biz^*« 
^i*. mxit i jSot*^ hfiiA< rsj -e. i^tot>^ 
>hfit*< T3j r-fc4«^i*, misfo ito r 5 j 
iSjjO r 3 j i^ss-r-Sffllic rij h-fs,, 



■f&ttov&ho -tut>*>mm. *-7>ni*< r 5 j <d 

ijg. *-7>hfitA< r 3 j <B j^*j£fiLf=S^ICI*. 

h'j^xrosst^is] i (D r 5 j t«7j|S) j © r 3 j t*< 
£Hf •SffliriiTc© rij ic rij sjmgLfc T2j *< 

[007 2] i ^1*. IFEDl«(DftSfl)fitiW 
£>. I FEDH«<D±T(DH3IA< i J&<!:fc-5<fc3l=ttJ* 

TThU^^S^SE^ti. C(DIFEDi««)7l>iJ 
*X£HB$±JigfT5IJPg (x, y) t^Oo 

[0073] ;:t\ &m^&mm189zmp^ r-*4« 

li«&l*3*Jt*&. i £j&<2Mtl-fc-& ( I FEDlf 
<7>aO>hflAM «Ji<D*#fcfil£*r-ra) i§^l*. j 
£t2lJgl~fe-5 (I FEDiftM-^HJi'l iy.hW 

[0 0 7 4] -tS. (gfflHiUA<Sfitma^P3 -C-fc4 
ffr2E<0 2*(0jlll@l^±<0SEIIgB»a)«i:5l=ffi<a 

fctfK i ^St j Miirtfift&LT^-Cfc. i ^A<21«il=*. 
[00 7 5] LfcA^T, f^#ifej$fT?IJPg (x, y) 

* e c<7jp^±jaff5"ja)!f#t±fiiA<i-y^it«t?fey, c 

®S (13) , fiydfe (difference entropy) 
6<Z>ft®g (14) . tfllfilcor (correlation ) £&-f 
&7toft&A (15) , ^— *>Hdm (inversediffere 
nee moment ) £ 8 (D*#»g (16) . X > h P ^ 

— se (sum entropy ) S^^"® 9 toftWi& (17) 

[0 0 7 6] 
[»1 0] 



(9) 



002-74325 



var= £ £ |( i - n x ) 2 • P K ( i , j )} (13) 

i i 

dfe= 2 { P x . y ( k ) • log | P K _ y ( k ) | } (14) 

k 

cor= £ £ [1 1 • j •P„(i > j)-iu x - ( u y )/(a 1 *a y )] (15) 
i i 

idm= £ £ [P R ( i , j ) / ( 1 + ( i - j ) *)] (16) 



se =-£ [P x+y (k)-log{P x + y (k)}] (17) 



# x = £ { i • P x ( I ) L My- 2 1J • P y ( j ) ) 
P 



x — ^ x x x . y i , y — ^ ij r y 

1 i 



x _ y (k) = SSP g (i, j), k = | i - j 
i j 



P X + y(k) - SZPgd,]), k = i + j 

i j 

a x 2 = 2 ( i - u x ) 2 • P x ( 1 ) 

i 

a y 2 = £ ( j - My) 2 • Py ( j ) 

P x ( 1 ) « j 7j\h)<D 7o 0 > a 

P K (1)=£P 8 (I, J) 
i 

P y ( j ) « i Jj l*J © :/ n V * 9 is 3 > ttft 

P y ( j ) = E P R ( 1 . j ) 



9uz % 7/\7/ e^m»sfflt^*:Hffliffl*a*ai3a 

PgJf^-^-5;U**:/ K9-^ (NN) Sffll^cfP 

[0077] e*Etts^fcw«B»:ai#« 

13aTM* % TExt (1) iZcfcy, ^^HSWlC#t>*iT 



( i = 2) frt><rj^t\=7; ex^!&Dm2££s:aju c 

[0 0 7 8] 
[»11] 



(10) 



*$g|2 O 02-74325 



fttcL * T. l \t/^^->^ z> 7s (i= 1 OlEI&m&t i = 2 <D 

mmfe&tort* - ><n%i) wi o^^ifft 

£.= (i/Ni) £ ( it- mi ) (j^-nfi) 1 

x e w i 

If = ( x 1 . x 2 . ■■- . x N ) 
nfi= ( 1/Ni) £ x* 



^aa^tii#i9:i2i= < t-or^c,*tfc9o©^asi*, * 

*l±.IE x 1 x U (xl, x2, x 

3, -, x9) tl^5 9^7c3SF^$^S-r-S, C©9& 

[0 0 7 9] CCT?]E»IS©fl)M°^->. JgttP£&C7>/\° 
9-^ tit. ^ft^ao^PS^MI-o^-CHKMlc 

^7Xwl . *S14&^<fc£:K-&ta)|::oi^-i:©.tffi'-<$' 

•So 

[0 0 8 0] -C-C. «»S^JaA^ttSKT?fc^«^IZ 
A<Jf't.o<«i:t^flSl5]A<ifcS (01 1#RS) . 

[008 1] ti>5atttl*Dm1/Dtn21?aS**t, 011 

©ffiSiFi5±l-:fcit*<iS#$^-ro -rtst?*. »*>5SU: 

a. 

[0 0 8 2] -?J, NN$fflt^ = P<Hi»tt^l4l3b-e 



A<Mfi£<kti-i> (01 2#fig) „ ^to^g-r— SUcfc 
ttA<m<. 0.0 lrjfilM§:£#l.tePt^T?fca^14A<i6 

[0 0 8 3] ¥U^K13cI±. P«Igtiti#8:l3a> 13 

b|:J:y#e,*ifc2 0cX)Pffifil<7)<tSSl=S^#. &m 

[0 0 8 4] «1«^ig,roi* : 5SttDii.1/'Dm2A<+»IZ*: 
#lMS£ffitt&£-e&-5pr«tM47!><ig<. +5*1=4**1*11: 
<!:iE«|g^-eifc*Rrfi6ttA<St^i:A^e). Dm1/Dm2^ 
10.0T?fcHtf+»ICStt^-Cfc*PltEtt*^<. Dml 

/Dm2^0. 1 T?fc*itf+»lciE«^.K-efc.S^IS6ttA<!t 

Jit) tiftjrf-ts. NN©ai*fiiA<i.o iciatMii: 

«tt^T?a5-i>pIfll14A<^<. 0.0 |:;ifii*fS£ftjH±tt 
^i?ifei>pItlttA<^t^ tfrl. ttl^jfB^O. 9 V&Hlt 

[0085] mm&&o>tp?mttomw±n<»mm&& 

[0 0 8 6] «>dStt:c7)fil7!><±iB<D<UiBl|S^t? 



(11) 



4#lfj2 002-74325 



®Bis?Mi=(aa-r«fcto. cco«ffl^iai*^si4^'T? 

gtt0>BB{t£ US L-CWJS-f-!). ^5StkA<2 

TPMn=**'Ma*fri.v *o>&m2&&nm$smt-r 

[0 0 8 7] C3t»ofc*a*J**t»IMe*#*LT« 
[0 0 8 8] Jt#Pg§M£aJ¥fft14l*. *IJS^K13c|C* 

[0 0 8 9] fcfc\ ±EHJSffij-r-i*^to2o(D«s#^ 

izzz&mmznm Lxfrb&ttwzzfr otMMis 

l\ 

[0 0 9 0] Sfc. 1S»<73*IISai=<fe.5ia^W'EC*lJS 

2 omm^mx-G* <o&mm ttt i=#*ijs^a@=eto 
(S«ia£*aiU ^amngirs-^-c. fl*.MHraa 

ya<t*fcto. ^ton^on/— ;u£Sto, ;u= 

[009 1] £f=. ±1BHJ6^1IIIC*5L^I*, 

<!: Lt?/^-' fc?XffiSt£ffll^fc®1 to*flS#/^fcJ:i; 
N N £ffll>fcSI 2 fl>*iJ5£3M££?iJffl LfcA<. ttf=*Mtt 

■e-cfyjg-ractt^ifirefea. 

[0 0 9 2] fcfc\ .tB5lilUfctSI=a3l*TI*. H®&& 

aj-r.&j&iBt&y^i.o 



[0093] ft*>\ «ail5to»iaa>%fittte«MtttiiS 

[0 0 9 4] *HJS(D^!|-CI*9oa)^fflfi$ffl 
^tztf. ±IE9 0©^®S<D«^1i-|c|Se)*t'5 ; fc<D-ei± 

[0 0 9 5] *f=. I^l$±fi)tff5lj^ftfi!c-r*ll8ic j 

i ^A<Stt-r-5»l*«©^l=»UrSST-. i jSAn 
€>2iim»f=ltRiraLfc^i:3tSL,fc*< (0 9#HS> . 

[0 0 9 6] ^SSB^IiV^^^^^-fCAD IcfgC, 

tlZ*,<DVlttJi<. B&5BCAD ^MA<A,CAD SS. 

[HB5toffiJ»&KH] 

[01] *ftno-*&Jt»Bl=J:«aaiMB1kMttH]B 

[0 2] T4 > )*-?4)V$Wm0)<fcm*:fii-tW 

[03] jieiiim j £+<C>£ Lfc«t5iimx«5iiI^(D 

*££©v**£s*-0 

[04] j l=£lt««E*9 

ftrflsuiBj-r-50 

[0 5] ||«rotttfiMMI=aikr«J:3l=ttS3*ife 

[0 6] ttMmO0*A£n«OlE*£tt-4-«fian 
£*-f0 

[07] I FEDl«A<0fiJ**l^ffl$*tl 
[08] I FEDIS$*tffi|l0 
[09] I FED0«l=*-3l*THB#£j8ff$fl£fl5tf-r 
•5fN3£jKT0 

[010] p^*figtT5ij**-r0 

[01 i] ^/\^/ exjE«sticj:Siiajs*iftBj-rsfcto 

090 

[01 2] ZLi-^U*-:/ H9-^lC<t^,*lJS$ittBJ-r 

*fcto«>0 
[^^<DiftBj] 

10 Batt£«ffl£ai£a 

ii ^*f«iisisffi^ia 

12 ^ssawtti^s: 

13 IS^S^Ift 
13 a PfiEflWtiU^K 
13 b fPfiffiflWtil^S 



(12) 



2002-74325 



13c 



14 m-%te&&m^m 



[E1 ] 



[13 2] 



gaga 



.,13a 



h: 



wags 



en 




[03] 







/i 


U 


f, 










ft. 






J 




f, 


/« 








f>. 




/"« 




fu 


f» 



[06] 




Pt.Pa 




(4) 




[B4] 



[H5] 




'0 • a 7 ^-«x,y) 




24 2 S 26 - 



[Hi 2] 



x£9 (pns was 



(13) 



<t$H2 002-74325 



[®7] 





[B8] 




H 


0 


1 


2 


3 


4 


5 


6 


7 


8 


9 


io 


0 


1 






















1 




1 




















2 
























3 
























4 
























5 








2 
















6 
























7 
























8 
























9 
























40 

























11 1 ] 



W>3BEtt=2 



(DmD 




(Drrr2) 



(14) ^i2002-74325 



F $ — A(##) 4C093 AA26 CA35 FD05 FF17 FF19 
FF20 FF43 FG20 
5B057 AA08 BA03 BA24 CA16 CB16 
CC03 CE06 CE11 CH09 DA08 
5C054 CA02 FC03 HA12 
5L096 BA06 EA23 FA33 FA34 FA66 
GA55 HA11 JA11 



002-74325 



[«ffB] 4$6fl7B (2002. 6. 7) 



[^BBS-^l *$gfl 2002-74325 (P2002-74325A) 
MB] 4^3^1 50 (2002. 3. 1 5) 

ttHttlf tttt 14-744 
[fciJ^S-^] ftM 2000-263641 (P2000-263641) 

G06T 1/00 290 

A61B 6/00 

G06T 7/00 350 



H04N 7/18 
[F I ] 

G06T 1/00 290 A 

7/00 350 A 
350 C 

H04N 7/18 K 

A61B 6/00 350 D 



[tiaiQ] «1 4$1fl28B (2002. 1. 2 [ttIE^&] 

8) HiiErtS] 

[*«HiE1 ] [0 0 4 9] 

[ffiiE»&&«*] wmm [a 5] 
M5E»asa«] oo4 9 



Ci(n)= X {(cos0.^ )/n },Rmin<n<Rmax (6) 



*=1 

-f (6) I*. te^^iiliSt «/S£Rmi t^IE^] 

(n) £t(D-efc£ 0 [0056] 

[^«&*tiE2] [» 7] 

[*§iE*tfiC$s*] vms 

[SHEttfUSB*] 00 5 6 

1 n 

Ci(n) = X cos 0. , ,Rmin<n<Rmax 

n-Rmin + 1^ Rmjn 



(6') 



-tUt>*>. 5$ (6') it. m&L&5tTtZ>mmfem<b Rmin rt^Rmax t LfcffiHl*J-C?gi+£C i (n) 



Intelligent CAD workstation for breast imagimig unsimg similarity to 
kBowm lesionns and mimltiple visnnal prompt aids 

Maryellen L. Giger*, Zhimin Huo, Carl J. Vyborny, Li Lan, loana Bonta, 
Karla Horsch, Robert M. Nishikawa, lngrid Rosenbourgh 
Department of Radiology, University of Chicago, Chicago, Illinois 60637, U.S.A. 

ABSTRACT 

While investigators have been successful in developing methods for the computerized analysis of mammograms and 
ultrasound images, optimal output strategies for the effective and efficient use of such computer analyses are still 
undetermined. We have incorporated our computerized mass classification method into an intelligent workstation 
interface that displays known malignant and benign cases similar to lesions in question using a color-coding scheme that 
allows instant visual feedback to the radiologist. The probability distributions of the malignant and benign cases in the 
known database are also graphically displayed along with the graphical "location" of the unknown case relative to these 
two distributions. The effect of the workstation on radiologists' performance was demonstrated with two preliminary 
studies. In each study, participants were asked to interpret cases without and with the computer output as an aid for 
diagnosis. Results from our demonstration studies indicate that radiologists' performance, especially specificity, 
increases with the use of the aid. 

1. INTRODUCTION 

Mammography is the most effective method for the early detection of breast cancer, and it has been shown that periodic 
screening of asymptomatic women does reduce mortality. Many breast cancers are detected and referred for surgical 
biopsy on the basis of a radiographically detected mass lesion or cluster of microcalcifications. Although general rules 
for the differentiation between benign and malignant mammographically identified breast lesions exists considerable 
misclassification of lesions occurs with human-interpretation methods and variations have also been observed in the 
positive biopsy rates of individual radiologists [1-6]. 

Breast sonography is used as an important adjunct to diagnostic mammography and is typically performed to evaluate 
palpable or mammographically identified masses in order to determine whether they are cystic or solid. Use of 
ultrasound for the diagnosis of simple benign cysts is accurate. However, many that prove to be indeterminate or solid 
on sonography are candidates for further intervention. 

Various investigators are developing methods for the computerized analysis of lesions on breast images with the 
computer output serving as an aid to the radiologist. However, optimal output strategies for the effective and efficient 
use of such computer analyses for computer-aided diagnosis are still undetermined. We have incorporated our 
computerized mass classification methods into an intelligent workstation interface, which displays similar malignant and 
benign known cases by use of a color-coding scheme allowing for instant visual feedback to the radiologist. 

1.1 Computerized Characterization of Mass Lesions on Mammography 

Our mass classification method includes three components: 1) automated segmentation of mass regions, 2) automated 
feature-extraction, and 3) automated classification [7-9]. The scheme was initially trained with 95 mammograms 
containing masses occurring in 65 patients. Features related to the margin, shape, and density of each mass are extracted 
automatically from the image data and merged into an estimate of the likelihood of malignancy using artificial neural 
networks. In a round-robin analysis, the computer classification scheme yielded an A 2 value of 0.94, similar to that of an 
experienced mammographer (A 2 =0.91) and statistically significantly higher than the average performance of five 
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radiologists with less mammbgraphic experience (A 2 =0.81). [7-8]. The computerized mass classification method was 
also independently evaluated on a 1 10-case clinical database containing 50 malignant and 60 benign mass cases. The 
effects of variations in both case mix and in film digitization technique on the performance of the method were assessed. 
In the task of distinguishing between malignant and benign lesions, the computer achieved an A 2 value (area under the 
ROC curve) of 0.90 on the prior training database (Fuji scanner digitization) in a round-robin evaluation, and A 2 values 
of 0.82 and 0.81 on the independent database for Konica and Lumisys digitization formats, respectively. However, in the 
statistical comparison of these performances, we failed to show a statistical significant difference between the 
performance on the training database and that on the independent validation database (p-values > 0.10). Thus, our 
computer-based method for the classification of lesions on mammograms is robust to variations in case mix and film 
digitization technique [9]. 

1.2 Computerized Characterization of Mass Lesions on Breast Sonography 

We have also developed a computerized method for the automatic classification of breast lesions on ultrasound. The 
computerized method includes automatic segmentation of the lesion from the ultrasound image background and 
automatic extraction of four features related to lesion shape, margin, texture, and posterior acoustic behavior [10-11]. 
Lesion shape is characterized by a depth-to-width ratio and lesion margin is characterized by the normalized radial 
gradient which yields the average orientation of the gray level gradients along the margin. Lesion texture is characterized 
an autocorrelation function and the posterior acoustic behavior is characterized by comparing the gray-level values 
posterior to the lesion to those in adjacent tissue at the same depth. These four features are merged through linear 
discriminant analysis to yield an estimate of the likelihood of malignancy. The linear discriminant function was 
determined using 409 cases. In an independent evaluation comprised of eleven jackknife trials, the computerized 
classification method yielded an average A z value (area under the ROC curve) of 0.87 in the task of distinguishing 
between malignant and benign lesions [11]. 

1.3. Intelligent workstation with multiple visual prompt aids 

We previously developed an intelligent workstation based on similarity to a known atlas of breast images [12]. We 
incorporated the mammographic and sonographic computerized mass classification methods into this workstation. Upon 
viewing an unknown case, the display shows both the computer classification output as well as images of lesions with 
known diagnoses (e.g., malignant vs. benign) and similar computer-extracted features. The similarity index used in the 
search can be selected by the radiologist and can be based on a single feature, multiple features, or on the computer 
estimate of the likelihood of malignancy. The output of a computer-aided diagnostic scheme can take a variety of forms 
such as the estimated likelihood that a lesion is malignant either in terms of probabilities or along a standardized rating 
scale. This information is then available for use by the radiologist when making decisions regarding patient management, 
as he or she sees fit. 

2. PRELIMINARY EVALUATION OF WORKSTATION 

In order to assess the potential usefulness of our intelligent workstation interface [12], we demonstrated the workstation 
at the 2000 and 2001 meetings of the Radiological Society of North America (RSNA) in Chicago, Illinois. The 
intelligent workstation used in these demonstrations displayed the estimate of the likelihood of malignancy and recalled 
lesions in the known database atlas based on the computer-estimate of the likelihood of malignancy. The similar lesions 
were displayed using a color-coding scheme that allowed for instant visual feedback to the radiologist regarding the 
malignancy of the atlas lesions, with red borders corresponding to malignant lesions and green borders corresponding to 
benign lesions. 

The observer portion of the 2000 demonstration included 20 unknown mammographic cases and 20 unknown 
sonographic breast cases. The 2001 demonstration study included 20 unknown cases for which both mammograms and 
ultrasound images were available. Half of the cases were cancerous and the other were benign, with truth obtained from 
pathology reports. Each participant was asked if they interpreted mammograms or mammograms on a regular basis in 
their practice. 
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In the 2000 mammographic study, each participant was presented with a "4 on 1" image collage indicating the location of 
the lesion in the standard screening mammograms, areas of interest in which the lesions were centered in the standard CC 
(cranio-caudal) and MLO (medial-lateral-oblique) views and on any available special views. The observer was then 
asked to indicate his or her likelihood of malignancy on a 0 to 100 scale and his or her patient management decision 
(whether or not to send the patient to biopsy). Next the computer-determined likelihoods of malignancy was given for 
the CC and MLO views of the lesion and similar cases from the reference atlas were displayed using the green and red 
coding as described early. (Figure 1) The known atlas for the mammographic cases included 169 cases (373 images). 
The observer was then asked to again indicate his or her likelihood of malignancy on a 0 to 1 00 scale and his or her 
patient management decision (whether or not to send the woman to biopsy), with the choice of "no change" being 
available. Windowing and leveling of the images was available. 

The 2000 sonographic study was similar to the mammographic one just described except that the participants were given 
two ultrasound images per case to use in their interpretation. The requested likelihood of malignancy and patient 
management decision were also asked before and after viewing of the computer aid prompts. The known atlas for the 
breast sonography cases included 27 1 cases (488 images). 

In the 2001 study, each participant was presented with a more clinically-realistic display in which both the mammograms 
and the ultrasound images from the case in question were shown. These cases, which were unknown to both the 
computer and the participant, included the 4-on-l whole breast mammograms, the regions of interest about the lesion in 
conventional and special mammographic views as well as the sonograms. The mammographic on-line atlas had 1 69 
cases (373 images) and the sonographic on-line atlas had 438 cases (865 images). The participant was asked to give their 
BI-RADS recommendation before and after seeing the computer output on both the mammograms and the sonograms. 
(Figure 2) 

As these were demonstration studies, the pathology (i.e., malignant or benign) was given after the second observer 
interpretation, that is, after presentation of the computer outputs. This method was employed to provide instant feedback 
in a learning situation and to encourage the RSNA participant to finish the study during the busy meeting. 

3. RESULTS 



The results in terms of sensitivity and specificity are tabulated below for both the single-modality studies from RSNA 
2000 and the multi-modality study from RSNA 2001 . All groups of participants for both modalities had equal or 
improved performance when using the intelligent workstation, although not all increases were statistically significant. 



Modality 


Participants 


Number of 
Participants 


Sensitivity 
without aid 


Sensitivity 
with aid 


p- value 


Specificity 
without aid 


Specificity 
with aid 


p-value 


Mammography 


Radiologists - 
Marhmo* 


29 


0.81 


0.83 


0.54 


0.62 


0.67 


0.28 




Others** 


13 


0.79 


0.85 


0.34 


0.55 


0.74 


0.0063 




















Ultrasound 


Radiologists - 
Mammo* 


22 


0.85 


0.85 


0.95 


0.61 


0.63 


0.66 




Others** 


11 


0.84 


0.86 


0.58 


0.34 


0.46 


0.0058 




















Multimodality 
(mammo/US) 


Radiologists - 
Mammo* 


48 


0.87 


0.87 




0.65 


0.70 


0.041 




Others** 


48 


! 0.66 


0.78 


0.0004 


0.70 


0.78 


0.0024 



* Radiologists who read mammograms as part of their practice. 

** All other participants, e.g. other radiologists, medical physicists, technologists. 

p-values from two-tail t-test 
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4. SUMMARY AND CONCLUSION 



Results from our demonstration studies indicate that radiologists' performance, especially specificity, increases with the 
use of the aid. As these were demonstration studies in which feedback was given, one needs to be cautious in extracting 
definitive conclusions. We are therefore currently conducting a rigorous observer study to show the benefit of the 
intelligent search workstation. 

The intelligent search workstation combines the benefit of computer-aided diagnosis with visual prior knowledge 
obtained from confirmed clinical cases. It is expected that the display of known lesions with similar features will aid the 
radiologist in his/her workup of a suspect lesion. 
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Figure 1 . Workstation interface for a malignant case from RSNA 2000. For this malignant case, the computer-estimated 
likelihood of malignancy was 63%. Both malignant (in red outline but shown as black in the paper) and benign (in green 
outline but shown as white in the paper) similar images were retrieved automatically by the computer for use by the 
participant. 
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Figure 2. Workstation interface for a malignant case from RSNA 2001 . For this malignant case, the computer output 
estimated an average likelihood of malignancy of 87% and 73% for the mammography and sonography images, 
respectively. Similar images automatically pulled from the on-line atlas were all malignant. 
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